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On a connection between the reliability of 



multi-channel systems and the notion of 
controUed-invariance entropy 



Getachew K. Befekadu 



Abstract 

The purpose of this note is to estabHsh a connection between the problem of reUabiUty (when there 
is an intermittent control-input channel failure that may occur between actuators, controllers and/or 
sensors in the system) and the notion of controlled-invariance entropy of a multi-channel system (with 
respect to a subset of control-input channels and/or a class of control functions). We remark that such a 
connection could be used for assessing the reliability (or the vulnerability) of the system, when some of 
these control-input channels are compromised with an external "malicious" agent that may try to prevent 
the system from achieving more of its goal (such as from attaining invariance of a given compact state 
and/or output subspace). 

Index Terms 

Invariance entropy, multi-channel system, topological feedback entropy, reliability. 

I. Introduction 



In the last decades, the notions of measure-theoretic entropy and topological entropy have been 
intensively studied in the context of measure-preserving transformations or continuous maps 
(e.g., see [|2T|. [fT9l and [[TT| for the review of entropy in ergodic theory as well as in dynamical 
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systems). For instance, Adler et al. (in the paper [H]) introduced the notion of topological entropy 
as a topologically invariant conjugacy, which is an analogue to the notion of measure-theoretic 
entropy, for measuring the rate at which a continuous map in a compact topological space 
generates initial-state information. Later, [fTOl and [|5] gave a new, but equivalent, definition of 
topological entropy for continuous maps that led to proofs for connecting the topological entropy 
with that of measure-theoretic entropy. 

In the recent paper [|9l, the authors have introduced the notion of invariance entropy for continuous- 
time systems as a measure of information that is necessary to achieve invariance of a given state 
(or output) subspace (i.e., a measure of how open-loop control functions have to be updated 
in order to achieve invariance of a given subspace of the state space). In the present paper, 
we explore this concept, which is closely related to the notion of topological feedback entropy 
(see [17] and lfT3l ). for assessing the reliability of a multi-channel system when there is an 
intermittent control-channel failure that may occur between actuators, controllers and/or sensors 
in the system. Specifically, we provide conditions on the minimum rate at which the multi- 
channel system can generate information with respect to a subset of control-input channels 
and/or a class of control functions when the system states are restricted to a given controUed- 
invariant subspaces. Here, it is important to note that the intermittent control-channel failures 
may not necessarily represent any physical failures within the system. Rather, this can also be 
interpreted as external "malicious" agent who is trying to prevent the system from achieving 
more of its goal, i.e., from attaining invariance of a given state (or output) subspace. 

With the emergence of networked control systems (e.g., see [j2J), these notions of entropy have 
found renewed interest in the research community (e.g., see [fTTl . [fTSl and flU). Notably, in the 
paper [fTTl . Nair et al. have introduced the notion of topological feedback entropy, which is 
based on the ideas of [HI, to quantify the minimum rate at which deterministic discrete-time 
dynamical systems generate information relevant to the control objective of set-invariance. More 
recently, the notion of controUed-invariance entropy (as well as the notion of almost invariance 
entropy) has been studied for continuous-time control systems in J6l, |[8l, [[T4l| and BUl based on 
the metric- space technique of (51. It is noted that such an invariant entropy provides a measure 
of the smallest growth rate for the number of open-loop control functions that are needed to 
confine the states within an arbitrarily small distance (in the sense of gap metric) from a given 
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subspace. For discontinuous systems, we also note that the notion of topological entropy has 
been investigated with respect to piecewise continuous piecewise monotone transformations (e.g., 
see [Ull and lfT6ll ). 

The paper is organized as follows. In Section [III we present preliminary results on the invariance 
entropy of multi-channel systems with respect to a set of control-input channels and a class of 
control functions. Section [in] presents the main results - where we provide conditions on the 
information this is necessary for achieving invariance of the multi-channel system states in (or 
near) a given subspace. 



II. Preliminaries 

A. Notation 

For A E M"^", B E M"^'' and a linear space the supremal (A, S)-invariant subspace 
contained in is denoted by Y* = sup f {A, B; JT). For a subspace C JT, we use {A \ f) 
to denote the smallest invariant subspace containing 



B. Problem formulation 

Consider the following generalized multi-channel system 

x{t) = Ax{t) + ^ BjUj{t), x{to) = Xq, t E [to, +00), (1) 

where A E M"""", Bj E M"^''^ x{t) e ^ C is the state of the system, Uj{t) E % C is 
the control input to the jth-channel and J\f = {1,2,..., A^} represents the set of controllers (or 
the set of control-input channels) in the system. 

Let us introduce the following class of admissible controls that will be used in the sequel 
^ - 1 ^ e JJ Loo(M, M'O u^j{t) E = W % for almost all t E [0, 00) and 

VjGA/'U{0}|, (2) 
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where u^o{t) = {ui{t), U2{t), . . . UN{t)) and u^,{t) = {ui{t), . . . . . . UN{t)) 

for i e Af. Moreover, X^o ^ M and M^^ = A/" \ {j} for j = 1, 2, . . . , A^. 

In the remainder of this subsection, we provide some results from geometric control theory (e.g., 
see (31, (221, 01 and (2011 for details about this theory). 

Definition 1: Ijti d 3^ for j e U U . 

(i) If % is (A) - invariant, then AYj C ^j. 

(ii) If is {A, S^j) -invariant, then AYj d + SS^j, where B-.^ = \ B^ B2 ... -Bat ], 
B^j = [ Bi ... Bj_i Bj+i ... Bn] and = Im B^j for j e TvU 

The following lemma, which is a well-known result, will be stated without proof (e.g., see fi22J 
or El). 

Lemma 1: Suppose 3j {A, B^j; ^) is a family of (A, -invariant subspaces for j E J\f. 
Then, every subspace ^ C ^ contains a unique supremal (A, 5-,^) -invariant subspace which 
is given by = sup 3j {A, B^j; ^) for each j G M. 

Then, we state the following result which is a direct application of Lemma [B 

Theorem 1: Let 'Y.j d 2^ for each j G M . Then, is a member of the subspace families 
3j{A,B^j\ 2^) that preserves the property of (A, i?^^) -invariant (i.e., ^ G 3j(y4, 5-,^; if 
and only if 

Ar^arj^dS^j, \/jeM. (3) 

Proof: The proof follows the same lines of argument as that of Wonham (see (22l p. 88). 
Suppose Yj G 3j{A,B^j; 2') and let G ^- for j G A/", then iA,J2ieN^^ BiKi)v^ = for 
some G i.e., 

Av^ = w^ - J2 Bi^i'^^ ^'^3+ ^-i' (4) 



'in this paper, we consider a case in wliich one of the controllers is extracted due to an intermittent failure. However, following 
the same discussion, we can also consider when the fault is associated with at most two or more possible controllers in the 
system. 
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On the other hand, let {vl,V2, ■ ■ ■ , vj^} be a basis for for j = 1,2, ... ,N. Suppose that ^ 
holds true. Then, there exist wl G Yj and u'^^ E '^-.j for /c G {1, 2, . . . , such that 

Avi = < - B^.^k'^ A; G {1, 2, ... , ^^}. (5) 

If we further define the following mapping K^j : — > '^-^j 

K%vi = u;\ ke{l,2,...,n^}, (6) 

and then by letting K^j to be any extension of K^^ to We, therefore, have {A+Y^^^j^ , BiKi)v\ 
wl G y, i.e., (A + J2i(^Af BiKi)yj C Yj, so that the controUed-invariant subspace Yj satis- 
fies 

y,e3,iA,B^,;J^), VjgAT. (7) 



Corollary 1: Let the subspace c be {A, B^j) - invariant for each j G A/'U {0}, then there 
exists a class of maps IC 3 K : that satisfies 

(8) 

Remark 1: Note that the controUed-invariant subspace 'Y , which is given in the aforementioned 
corollary, is also a subspace of 'f* (see also Equation ^ below) 



Next, we introduce the following theorem on the family of supremal controUed-invariant sub- 
spaces that will be useful for our work in the next section. 

Theorem 2: Let QJ = {^*}jeAr be a set of supremal controUed-invariant subspaces with respect 
to the family of systems { (A, B^^) j^^^- Then, the set 2J forms a lattice of controUed-invariant 
subspaces. Moreover, there exists a unique (nonempty) subspace that satisfies 



fj C sup 3j{A, B^f, 3^), Vj eU, 3 u^j G ) , (9) 



where = sup 3j (^{A + Y.t&N^^ B,Ki),^j^ and ^ = Im Bj for aU j G Af. 
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Proof: Note that fj + Y^j E 2J and f] f^j e 2J for all j G Af. Moreover, if we define 
the gap metric gj{fo,fj) between the controUed-invariant subspaces % and as 

g,{%,r,) = \\Pr,-Pr^l Vj G AT, (10) 

where 1^ = sup 3o{A, B^q] Py^^ and f ^ are orthogonal projectors on and Yj, respectively. 
Then, the set of all controUed-invariant subspaces in ^ forms a compact metric state-space with 
respect to the above gap metric (see also [|T2l ). On the other hand, let us define the following 
family of subspaces 



r = <{ fl ^ 



Yj C sup 3j (A, B^j ; ) , Vj G A/", 3 G '^^j L (11) 



Suppose the subspace Y* exists, then it is a unique member of the family that is defined in (fTTj) . 
i.e., 

Y* = Y* G Y, (12) 

with Y* = supJj (^(^ + EieAA-., BiKi),^j^ for all j G J\f. Note that we have Yj = {A + 
T^ieAf^. BiKil^j) which also implies that ImBj C t^*!] ■ 



C. Properties of (controlled)-invariance entropy 

In the following, we start by giving the definition of (controlled)-invariance entropy for the 
multi-channel system in ^ with respect to the subset of control-input channels and that class 
of control functions. 

Definition 2: For a given subspace ^ C Y* E Y with nonempty interior and T, e > 0, the 
class of control functions ^(T, e, ^, Y*) C is called (T, e, ^, >^*)-spanning, if there exits 
u G ^(T, e, ^, Y*) for almost all t G [0, T) such that 

max sup inf \\(j)^j{t,XQ,u^j{t)) — y\\ < e, Vxq G (13) 

i^-^ te[o,T] ?/e-^* 

^We remark that the induced continuous maps in j^j and JT/^*, admit an enveloping lattice for the family of controUed- 
invariant subspaces "V* , Vj G M (e.g., see ||T2| ). 
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Remark 2: In the aforementioned definition, we use the notation xq, u^j{t)) to denote the 

unique solution of the multi-channel system with initial condition xq G ^ and control u^j G '^^j, 
i.e., 



for each j G A/'U {0}. 

Moreover, the relation + to,xo,u^j{t)) = (j)^j{t, (p^j{t, xo,u^j{t)),u^j{to + .)) will also 

hold for all j G TVu {0}. 

Let rinv(T, e, ^, f*) be the smallest cardinality of ^(T, e, ^, y*)-spanning sets. Then, we have 
the following properties for n^wiT, e, 1^*). 

(i) Clearly n^,{T,e,^ ,f*) G [0, cx))S 

(ii) If ei < £2, then rinv(r, ei, ^, f*) > n^^{T, 62, ^, f*). 

Definition 3: The (controlled)-invariance entropy of the multi-channel system in ^ (i.e., with 
respect to the subset of control-input channels and/or the class of control functions) is given by 



Remark 3: We remark that the existence of such a limit in the aforementioned definition for 
^inv(^)^*) follows directly from the monotonicity of riav{T,e, ^ with respect to e. 
Moreover, such an invariance entropy /iinv(^, ^*) equals to the minimum amount of information 
that is required to render y*-invariant subspace by using a causal coding and/or control law 
(see [7] for discussion on single control-channel systems). 

Then, we have the following properties for /iinv(^, Y*). 



X{t) = (f)^j{t,Xo,U^j{t)) 




/iinv(^, f*) = lim <^ lim - log rin,(T, e, ^, f*) 




(15) 



(i) h,^,{J^,r*) G [0, cx))U{cx)}. 



^The value of rinv(r, e, Y*) could be an infinity. 
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(ii) If ^ = Ue{i,2,...,L} ^« with compact ^i, V/ G {1,2,...,L}, then K,^{,^ ,f*) = 
maXi6{i,2,...,L} hnA-^h 'y*)- 

In the following, we state the main problem of this paper - where we establish a connection 
between the invariance entropy of a multi-channel system and the reliability of a multi-channel 
system. 

Problem: Find a condition on the minimum amount of "information" (with respect to the subset 
of control-input channels and/or the class of control functions) that is necessary to keep the 
states of the multi-channel system in a given subspace y*. 



III. Main Results 

In this section, we present our main results - where we provide a connection between the 
invariance entropy (as a measure of "information" needed with respect to the subset of control- 
input channels to keep the system in (or near) this compact subspace) and the reliability of 
the multi-channel system (when there is an intermittent channel failure that may occur between 
actuators, controllers and/or sensors in the system). 

Theorem 3: Suppose that Theorem |2] holds true and let ^ be a subspace of Y*. For every 
xq G ^, if there exists u{t) G 'rf{T, e, ^, Y*) for almost all t G [0, T] that renders f"* -invariant, 
then the (controlled)-invariance entropy of the multi-channel system is given by 

/iinv(=^,^*) =lim ( IHK hogr,^,{T,e,^,y*) ] . (16) 

Proof: For any subspace ^ C Y*, suppose there exists u(t) G ^{T, e, Y*) for almost 
all t G [0, T] such that 

sup inf \\(j)^j{t,XQ,u^j{t)) — y\\ < e, Vj G J\f, Vxq G 

tG[0,T] ye f* 

with some finite-positive number e > 0. Then, we see that (fT6l) (i.e., the (controlled)-invariance 
entropy of the multi-channel system in ([T])) will directly follow. Moreover, the supremum is 
taken overall the set of all admissible controls that renders -invariant. ■ 
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Remark 4: We remark that the aforementioned theorem essentially states that the set of admis- 
sible controls renders 1^* -invariant, even if there is an intermittent failure in any one of the 
control-input channels. Note that this quantity (which is also the minimum growth rate for the 
number of open-loop control functions with respect to intermittently faulty channel) provides a 
condition on the minimum amount of "information" that is necessary to keep the system states 
in (or near) this subspace. 

We conclude this section with the following result which is an immediate corollary of Theorem |3] 



Corollary 2: Suppose there exists a finite-positive number e/c > such that 

max sup inf \\(l)^j{t,Xo,u^j{t)) — y\\ < e, Wxq G (17) 

iG[0,T] yer^ 

where 

y* = sup i Pi -Tj Yj C sup 3j{A, B^y, JT), Vj G A/", 3K eic \ D^. (18) 
[jeM J 

Then, the (controlled) -invariance entropy of the multi-channel system in ([U) is given by 

hU-^,f^) = lim ( lEK 1 log ri„.(T, eye, ] • (19) 

Remark 5: Note that the bounds for /iinv(^, ^*) and /iinv(=^, are different, since they may 
depend on their respective classes of control functions. Moreover, the following hm^{^, Y*) < 
^mv(^,'^*) also holds true. 
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